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There is accumulating evidence that biological neural 
networks posses optimal computational capacity when 
they are at or near a critical point in which the net- 
work transitions to a chaotic regime. We derive a for- 
mula for the critical point of a general heterogeneous 



neural network. This formula relates the structure of 
the network to its critical point. The heterogeneity 
of the network may describe the spatial structure, a 
multiplicity of cell types or any selective connectivity 
rules. 
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Figure 1 (A) Example spectra of connectivity matrices (gray) with r>l (top, indicated in blue and purple respectively) and r<l (bottom). The 
average synaptic gain (red) does not give the correct boundary of the spectrum and would predict opposite behavior The matrix Gc(i)d(j) is 
indicated by the color plots (top), and activity of representative neurons from the two groups (bottom) of each example. (B) The activity of a 
readout unit during spontaneous activity, a FORCE learning epoch, and post learning for neurogenic and homogeneous subcritical networks. The 
neurogenic network quickly matches the target signal (gray) and robustly reproduces it. (C) The learnability of an ensemble of neurogenic 
networks as a function of the hyperexcitability and new neuron fraction coincides with contour lines of r (white). 
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To define the network we divide the N neurons into D 
groups such that Zd=i...DNd=N- The synaptic weight 
between neurons i,] (the connectivity matrix element /y) 
is drawn from a centered distribution with standard 
deviation summarized in a Dy.D rule matrix N'^''^Gc(i)d(j) 
(insets to A, c{i) is the type index of neuron /). The net- 
work obeys the standard rate dynamics {d/dt)xi=- Xi 
+Z/=i...N/ij tanh^y. 

The global behavior of the network changes from a 
single fixed point to chaos when r=l, r being the radius 
of the circle that bounds the spectrum of the connectiv- 
ity matrix (panel A). We derived a formula, in terms of 
the matrix G and the vector Nd, for r that can also be 
thought of as an effective gain[l]: it is the square root of 
the maximal eigenvalue of a Dv-D matrix M whose c,d 
element is M^d= N^^KiG^df. 

We use our understanding of the general heterogeneous 
dynamical system to a network with a large fraction of 
cells in the subcritical regime, and a small fraction of 
supercritical neurons. This can be thought of as a model 
of a network where adult neurogenesis occurs, where a 
small fraction of hyperexcitable neurons are continuously 
integrated. Using a supervised learning algorithm (FORCE, 
[2]) we show that r is as a good coordinate to describe the 
network's "learnability" (Figure 1 panels B,C). Learning is 
optimal for values of r similar to those found in a homoge- 
nous network. Our results suggest that the new neurons 
can allow the network to be poised at criticality with no 
global changes to connectivity, and that their specific roles 
are context dependent, in contrast to previous hypotheses. 
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